© Pergamon 


Neural Networks, Vol. 9, No. 9, pp. III-XVI, 1996 
Copyright © 1996 Published by Elsevier Science Ltd. All rights reserved 
Printed in Great Britain. 

0893-6080/96 $15.00 + .00 


Contents 


Volume 9, 1996 


NEURAL NETWORKS 


Volume 9, Number 1 


Hung-Jen Chang 
Walter J. Freeman 


William R. Softky 


Shin Ishii 
Kenji Fukumizu 
Sumio Watanabe 


Christian W. Omlin 
C. Lee Giles 


Christopher M. Thomas 
William G. Gibson 
John Robinson 


Mostefa Golea 
Mario Marchand 
Thomas R. Hancock 


Régis Lengelle 
Thierry Deneux 


Riidiger W. Brause 


Akira Hasegawa 
Kenji Shibata 
Kazuyoshi Itoh 
Yoshiki Ichioka 
Kiyonari Inamura 


15 


41 


53 


67 


121 


January 1996 
CONTENTS 


Editorial 
Neural Networks Referees in 1995 


Contributed Articles 
Neuroscience and Neuropsychology 


Parameter Optimization in Models of the Olfactory Neural System 


Mathematical and Computational Analysis 
Fine Analog Coding Minimizes Information Transmission 


A Network of Chaotic Elements for Information Processing 


Extraction of Rules from Discrete-time Recurrent Neural Networks 


Stability and Bifurcations in an Associative Memory Model 


On Learning p-Perceptron Networks on the Uniform Distribution 


Training MLPs Layer by Layer Using an Objective Function for 
Internal Representations 


Sensor Encoding Using Lateral Inhibited Self-organized Cellular 
Neural Networks 


Technology and Applications 


An Adaptive Neural Network: Application to Character Recogni- 
tion on X-ray Films 


II 


. 
xiii 


IV 


Contents/ Author Index 


Elizabeth C. Botha 129 Feature-based Classification of Aerospace Radar Targets Using 
Etienne Barnard Neural Networks 
Charl J. Barnard 
Andrew M. Ukrainec 143 A Modular Neural Network for Enhancement of Cross-polar Radar 
Simon Haykin Targets 
Ralf Ostermark 169 A Flexible Multicomputer Algorithm for Artificial Neural Net- 
works 
Book Review 
Charles T. Butler 179 Neural Networks, Theory and Practice edited by Richard J. 
Mammone and Yehoshua Zeevi 
185 Current Events 
1 INNS/ENNS/JNNS Membership Application Form 
Il Instructions to Authors 
Volume 9, Number 2 March 1996 
CONTENTS 
Contributed Articles 
Psychology and Cognitive Science 
Yutaka Hirakura 189 Dynamic Linking Among Neural Oscillators Leads to Flexible 
Yoko Yamaguchi Pattern Recognition with Figure-Ground Separation 
Hiroshi Shimizu 
Shinichi Nagai 
Neuroscience and Neuropsychology 
Kenji Okajima 211 A Model Visual Cortex Incorporating Intrinsic Horizontal 
Neuronal Connections 
S. Azizi 223 A Unified Analysis of Alpha Rhythm, Fast Synchronized 
H. Og Oscillations, and Flash Visual Evoked Potentials 
B. H. Jansen 
Mathematical and Computational Analysis 
Bill G. Horne 243 Bounds on the Complexity of Recurrent Neural Network 
Don R. Hush Implementations of Finite State Machines 
Iku Nemoto 253 Complex Associative Memory 
Makoto Kubono 
Derek Partridge 263 Network Generalization Differences Quantified 
Mark Plutowski 273 Experience with Selecting Exemplars from Clean Data 
Garrison Cottrell 


Halbert White 


Contents/ Author Index V 


Guszti Bartfai 295 On the Match Tracking Anomaly of the ARTMAP Neural Network 
A. L. Yuille 309 Dimension Reduction, Generalized Deformable Models and the 
J. A. Kolodny Development of Ocularity and Orientation 

C. W. Lee 

Todd W. Troyer 321 Feedforward Hebbian Learning with Nonlinear Output Units: a 


Lyapunov Approach 


Technology and Applications 


Hee-Heon Song 329 LVQ Combined with Simulated Annealing for Optimal Design of 
Seong-Whan Lee Large-set Reference Models 
James E. L. Hollis 337 Feature Vectors for Road Vehicle Scene Classification 


David J. Brown 
Ian C. Luckraft 
Christopher R. Gent 


Akira Hasegawa 345 Generalization of Shift Invariant Neural Networks: Image 
Kazuyoshi Itoh Processing of Corneal Endothelium 
Yoshiki Ichioka 
Yasunari Obuchi 357 Weighted Parallel Problem Solving by Optimization Networks 
Hironari Masui 
Masaru Ohki 
367 Current Events 
I INNS/ENNS/JNNS Membership Application Form 
Il Instructions to Authors 
Volume 9, Number 3 April 1996 
CONTENTS 
Neural Networks Letter 
H. Kong 373 A Neural Network Adaptive Filter for the Removal of Impulse 
L. Guan Noise in Digital Images 
Contributed Articles 
Psychology and Cognitive Science 
Sadayuki Hongo 379 Edge-based Binocular Stereopsis Algorithm—-A Matching Mechan- 
Noboru Sonehara ism with Probabilistic Feedback 


Isamu Yoroizawa 


Neuroscience and Neuropsychology 


Alexander V. Lukashin 397 Modeling of Directional Operations in the Motor Cortex: a Noisy 
George L. Wilcox Network of Spiking Neurons is Trained to Generate a Neural- 
Apostolos P. Georgopoulos Vector Trajectory 

Ruye Wang 411 A Network Model for the Optic Flow Computation of the MST 


Neurons 


| 
—— 


VI Contents/Author Index 
George A. Christos 427 Investigation of the Crick—Mitchison Reverse-learning Dream Sleep 
Hypothesis in a Dynamical Setting 
Mathematical and Computational Analysis 
Erkki Oja 435 Robust Fitting by Nonlinear Neural Units 
Liuyue Wang 
F. Schwenker 445 Iterative Retrieval of Sparsely Coded Associative Memory Patterns 
F. T. Sommer 
G. Palm 
Lutz Prechelt 457 A Quantitative Study of Experimental Evaluations of Neural 
Network Learning Algorithms: Current Research Practice 
Mary M. Moya 463 Network Constraints and Multi-objective Optimization for One- 
Don R. Hush class Classification 
Theodore B. Trafalis 475 Neural Network Training via an Affine Scaling Quadratic 
Nicolas P. Couellan Optimization Algorithm 
Zong-Ben Xu 483 Asymmetric Hopfield-type Networks: Theory and Applications 
Guo-Qing Hu 
Chung-Ping Kwong 
Olivier Frangois 503 New Rigorous Results for the Hopfield’s Neural Network Model 
Engineering and Design 
Masumi Ishikawa 509 Structural Learning with Forgetting 
Takashi Matsumoto 523 A Massively Parallel Resistive Network for ““Weak Rod”: A 
Kenji Kondo Double-layer Architecture with Nearest-neighbor Connections 
Book Reviews 
Sam Leven 543 The Roots of Backpropagation: From Ordered Derivatives to 
Neural Networks and Political Forecasting by Paul J. Werbos 
Raju S. Bapi 545 Artificial Intelligence and Neural Networks: Steps Toward 
Sue L. McCabe Principled Integration edited by Vasant Honavar and Leonard Uhr 
Rajkumar Roy 
549 Current Events 
I INNS/ENNS/JNNS Membership Application Form 
Il Instructions to Authors 
Volume 9, Number 4 June 1996 
CONTENTS 
Contributed Articles 
Neuroscience and Neuropsychology 
S. P. Tonkin 555 Stability of a Class of Directionally Sensitive Asymmetric Nonlinear 


Neural Networks 


R. B. Pinter 
B. Nabet 


Contents/Author Index 


W. Kilmer 


W. Senn 

K. Wyler 

J. Streit 

M. Larkum 
H.-R. Liischer 
H. Mey 

L. Miiller 


D. Stainhauser 


K. Vogt 
Th. Wannier 


R. Salomon 
J. L. van Hemmen 


R. S. Neville 
T. J. Stonham 


Chyi-Tsong Chen 
Wei-Der Chang 


A. Goltsev 


Wen-Yuan Chen 
Sin-Horng Chen 
Cheng-Jung Lin 


Cheng-Yuan Liou 
Jiann-Ming Wu 


A. Shustorovich 
C. W. Thrasher 


H. Szu 
B. Telfer 
J. Garcia 


Qun Zhao 
Zheng Bao 


H. N. Mhaskar 


J. Wray 
G. G. R. Green 


H. Stowell 


K. Aihara 
K. T. Judd 


567 
575 


603 


627 


643 


655 


671 


VII 


Global Inhibition for Selecting Modes of Attention 


Dynamics of a Random Neural Network with Synaptic Depression 


Mathematical and Computational Analysis 


Accelerating Backpropagation through Dynamic Self-Adaptation 


Adaptive Critic for Sigma—Pi Networks 


Engineering and Design 


A Feedforward Neural Network with Function Shape Autotuning 


An Assembly Neural Network for Texture Segmentation 


Technology and Applications 

A Speech Recognition Method Based on the Sequential Multi-layer 
Perceptrons 

Self-Organization Using Potts Models 

Neural Network Positioning and Classification of Handwritten 
Characters 


Wavelet Transforms and Neural Networks for Compression and 
Recognition 


Radar Target Recognition Using a Radial Basis Function Neural 
Network 


Letters to the Editor 
Neural Networks and Approximation Theory 


Author’s Response 


Naming the Neuron in Vain 


Author’s Response 


|— 


Vil Contents/Author Index 

Book Review 
V. Brown 727 A Vision of the Brain by Semir Zeki 
B. Breitmeyer 

731 Current Events 
I INNS/ENNS/JNNS Membership Application Form 
Il Instructions to Authors 
Volume 9, Number 5 July 1996 
CONTENTS 

Contributed Articles 

Mathematical and Computational Analysis 
H. Koyama 737 Analysis of the Recalling Processes of Associative Memory by an 
N. Fujie Integral Representation of the Sign Function 
T. Fujiwara 
S. Clippingdale 747 Self-similar Neural Networks Based on a Kohonen Learning Rule 
R. Wilson 
D. A. Sprecher 765 A Numerical Implementation of Kolmogorov’s Superpositions 
J.-C. Fort 773 About the Kohonen Algorithm: Strong or Weak Self-organization? 
G. Pages 
N. R. Pal 787 Sequential Competitive Learning and the Fuzzy c-Means Clustering 
J. C. Bezdek Algorithms 
R. J. Hathaway 
K. Pakdaman 797 Single Neuron with Recurrent Excitation: Effect of the Transmis- 
J.-F. Vibert sion Delay 
E. Boussard 
N. Azmy 
A. Menon 819 Characterization of a Class of Sigmoid Functions with Applications 
K. Mehrotra to Neural Networks 
C. K. Mohan 
S. Ranka 
S. Coombes 837 Using Features for the Storage of Patterns in a Fully Connected Net 
J. G. Taylor 
S. H. Zak 845 Learning and Forgetting in Generalized Brain-state-in-a-box (BSB) 
W. E. Lillo Neural Associative Memories 
S. Hui 
A. Kolez 855 N-tuple Regression Network 
N. M. Allinson 
K. Fukumizu 871 A Regularity Condition of the Information Matrix of a Multilayer 


Perceptron Network 


: ¢ 


Contents/ Author Index 


IX 
Engineering and Design 
J. R. Williamson 881 Gaussian ARTMAP: A Neural Network for Fast Incremental 
Learning of Noisy Multidimensional Maps 
Technology and Applications 
Wen-Gou Lin 899 A New Neural Model for Invariant Pattern Recognition 
Shuenn-Shyang Wang 
915 Current Events 
I INNS/ENNS/JNNS Membership Application Form 
Il Instructions to Authors 
Volume 9, Number 6 August 1996 
CONTENTS 
Contributed Articles 
Psychology and Cognitive Science 
H. Neumann 921 Mechanisms of Neural Architecture for Visual Contrast and 
Brightness Perception 
Mathematical and Computational Analysis 
D. Saad 937 General Gaussian Priors for Improved Generalization 
N. Murata 947 An Integral Representation of Functions Using Three-layered 
Networks and Their Approximation Bounds 
Tao Wang 957 Asymptotic Stationarity of Discrete-time Stochastic Neural Net- 
Zhaohan Sheng works 
M. Meltser 965 Approximating Functions by Neural Networks: A Constructive 
M. Shoham Solution in the Uniform Norm 
L. M. Manevitz 
M. H. Erdem 979 A New Family of Multivalued Networks 
Y. Ozturk 
J. Zhao 991 Learning in Stochastic Bit Stream Neural Networks 
J. Shawe-Taylor 
M. van Daalen 
Zong-Ben Xu 999 A Decomposition Principle for Complexity Reduction of Artificial 
Chung-Ping Kwong Neural Networks 
J. Sima 1017  ~+Back-propagation is not Efficient 
T. Serrano-Gotarredona 1025. A Modified ART | Algorithm more Suitable for VLSI Implementa- 
B. Linares-Barranco tions 
Y. Bissessur 1045 ~— Buried Plant Detection: A Volterra Series Modelling Approach 


R. N. G. Naguib 


Using Artificial Neural Networks 


‘ 


Contents/Author Index 


Engineering and Design 


O. Yadid-Pecht 1061 Efficient Biologically-based Pattern-recognizing Networks 
MM. Gur 
D. A. Cohn 1071 Neural Network Exploration Using Optimal Experiment Design 
Li Yaoyong 1085 _— Letter to the Editor 
Zheng Nanning 
B. Amirikian 1086 Response to the Letter by Li Yaoyong and Zheng Nanning 
H. Nishimura 1087 Response to the Letter by Li Yaoyong and Zheng Nanning 
1089 Current Events 
I INNS/ENNS/JNNS Membership Application Form 
II _Instructions to Authors 
Volume 9, Number 7 October 1996 
CONTENTS 

Neural Networks Letter 
H. Kakeya 1095 —_ Hierarchical Concept Formation in Associative Memory Composed 
T. Kindo of Neuro-window Elements 

Contributed Articles 

Psychology and Cognitive Science 
DeLiang Wang 1099 On Temporal Generalization of Simple Recurrent Networks 
Xiaomei Liu 
S. C. Ahalt 

Neuroscience and Neuropsychology 
J. Shrager 1119 Dynamic Plasticity Influences the Emergence of Function in a 
M. H. Johnson Simple Cortical Array 
J. Pavlasek 1131 Time Intervals Comparing Neural Network 
J. Poledna 
F. Jagla 

Mathematical and Computational Analysis 
Y. Fang 1141 Dynamics of a Winner-Take-All Neural Network 
M. A. Cohen 
T. G. Kincaid 
V. Beiu 1155 On the Circuit Complexity of Sigmoid Feedforward Neural 
J. G. Taylor Networks 
I. Varga 1173. the Brain-State-in-a~-Convex-Domain Neural Models 
G. Elek 
S. H. Zak 
J. A. Flanagan 1185 _— Self-organisation in Kohonen’s SOM 


Contents/ Author Index 


Ching-Tsan Chiang 
Chun-Shin Lin 


Dong-Gyu Jeong 
Soo-Young Lee 


W. Weng 
K. Khorasani 


M. Peng 
N. K. Gupta 
A. F. Armitage 


1199 


1213 


1223 


XI 


CMAC with General Basis Functions 


Engineering and Design 


Merging Back-propagation and Hebbian Learning Rules for 
Robust Classifications 


Technology and Applications 


An Adaptive Structure Neural Networks with Application to EEG 
Automatic Seizure Detection 


An Investigation into the Improvement of Local Minima of the 
Hopfield Network 

Errata 

Current Events 


INNS/ENNS/JNNS Membership Application Form 


Instructions to Authors 


Volume 9, Number 8 


1996 
CONTENTS 


1996 Special Issue: Four Major Hypotheses in Neuroscience 


Schaal 


1263 


1265 


1281 


Introduction 
1996 Special Issue: Four Major Hypotheses in Neuroscience 
1996 Special Issue Articles 


Forward and Inverse Models of the Motor Apparatus are Acquired by 
Motor Learning 


Forward Models for Physiological Motor Control 


A Kendama Learning Robot Based on Bi-directional Theory 


| 
1255 
1257 
II 

K. Toyama | 

N. Sugie 

M. Kawato 

R. C. Miall 
D. M. Wolpert 

H. Miyamoto 

S. 

F. Gandolfo 

H. Gomi 

Y. Koike 

R. Osu 

E. Nakano 

Y. Wada 

M. Kawato 


XII 


Contents/Author Index 


Covariance Learning Rule 


H. Fujii 1303. Dynamical Cell Assembly Hypothesis — Theoretical Possibility of 
H. Ito Spatio-temporal Coding in the Cortex 
K. Aihara 
N. Ichinose 
M. Tsukada 
K. Toyama 1351 Imaging a Computational Process in the Visual Cortex 
M. Tanifuji 
M. Tsukada 1357. Hippocampal LTP Depends on Spatial and Temporal Correlation 
T. Aihara of Inputs 
H.-A. Saito 
H. Kato 
Chi-Sang Poon 1367 _—Self-tuning Optimal Regulation of Respiratory Motor Output by 
Hebbian Covariance Learning 
Functional Roles of Feedforward and Feedback Connections Between 
Cortical Areas in Cognition 
P. Dayan 1385 ‘Varieties of Helmholtz Machine 
G. E. Hinton 
K. Takebe 1405 A Computational Model for Color Constancy by Separating 
S. Nakauchi Reflectance and Illuminant Edges within a Scene 
S. Usui 
M. Kikuchi 1417 Neural Network Model of the Visual System: Binding Form and 
K. Fukushima Motion 
Sparse Coding in Memory Representation 
M. Okada 1429 Notions of Associative Memory and Sparse Coding 
K. Tanaka 1459 _— Representation of Visual Features of Objects in the Inferotemporal 
Cortex 
M. Morita 1477 Memory and Learning of Sequential Patterns by Nonmonotone 
Neural Networks 
I INNS/ENNS/JNNS Membership Application Form 
Il Instruction to Authors 
Volume 9, Number 9 1996 
CONTENTS 
Neural Networks Letter 
A. A. Ezhov 1491 Object Generation with Neural Networks (When Spurious 
V. L. Vvedensky Memories are Useful) 


Contents/Author Index 


K. P. Krommenhoek 
A. J. Van Opstal 

J. 

G. 


allis 


J. A. S. Freeman 
D. Saad 


N. Kurita 
K. Funahashi 


M. Georgiopoulos 
H. Fernlund 

G. Bebis 

G. L. Heileman 


F. X. Albizuri 

A. D’ Anjou 

M. Grajiia 

J. Antonio Lozano 


> Py 

= 

& 


P. 
J. 
A. M. Van Gisbergen 
WwW 


1497 


1513 


1521 


1531 


1541 


1561 


1569 


1583 


1597 


1619 


1639 


XVII 


XIII 
Contributed Articles 
Neuroscience and Neuropsychology 


An Analysis of Craniocentric and Oculocentric Coding Stages in a 
Neural Network Model of the Saccadic System 


Using Spatio-temporal Correlations to Learn Invariant Object 
Recognition 


Mathematical and Computational Analysis 


Radial Basis Function Networks: Generalization in Over-realizable 
and Unrealizable Scenarios 


On the Hopfield Neural Networks and Mean Field Theory 


Order of Search in Fuzzy ART and Fuzzy ARTMAP: Effect of the 
Choice Parameter 


Convergence Properties of High-order Boltzmann Machines 


POPFNN: A Pseudo Outer-product Based Fuzzy Neural Network 


Fast Second Order Learning Algorithm for Feedforward Multilayer 
Neural Networks and its Applications 


On-line Supervised Adaptive Training Using Radial Basis Function 
Networks 


Engineering and Design 


Radial Basis Function Network Configuration Using Mutual 
Information and the Orthogonal Least Squares Algorithm 


Technology and Applications 


Force Parameters for On-line Tool Wear Estimation: A Neural 
Network Approach 


Current Events 
1996 Volume Contents and Author Index 
INNS/ENNS/JNNS Membership Application Form 


Instructions to Authors 


| 
R. W. Zhou 
C. Quek 
P. Bojarez 
P. Bojarczak 
M. Stodolski 
S. A. Billings 
W. Luo 
S.A, Billing 
S. A. Billings 
1647 
I 


| 
| 
| 
| 
| 
| 
| 
| 
\ 
{ 
| 
= ~ - = 


